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This  work  presents  an  abstract  optimality  theory.  The  discussed 
concepts  (e.g.  extremal,  Lagrangian,  duality)  are  more  general  and  much 
simpler  than  their  familiar  counterparts  used  in  more  concrete  framework. 

They  admit  geometrical  interpretations  and  help  to  clarify  the  underlying 
ideas  of  the  theory.  Consequently,  the  presented  theory  suggests  further 
theoretical  developments  and  possible  applications^  (e.g.  the  use  of 
Lagrangians  of  the  form  different  from  the  usually  us^  (3.7);  Example  3.4.). 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  MRC  ,  and  not  with  the  author  of  this  report. 


ABSTRACT  OPTIMALITY  THEORY 
Szymon  Dolecki 

Introduction 

This  work  presents  the  underlying  ideas  and  basic  notions  of 
optimality  theory  (e.g.,  extremal,  Lagranglan,  penalty,  duality)  in  an 
abstract  setting. 

The  mathematics  of  the  work  is  simple,  abounding  with  geometrical 
interpretations  through  which,  it  is  hoped,  the  structure  of  the  theory  becomes 
apparent,  motivating  later  developments. 
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Grant  AFOSR-79-''018  and  by  the  Office  of  Naval  Research  Contract 


041-404. 


2 


1.  Solutions  ,  representations  ,  extremals 

A  minimization  problem  is  represented  as  a  triple 

(1.1)  (f,A,(X,T)) 

where  (X,  t)  Is  a  topological  space,  f  is  a  function  defined  on  X 
valued  in  R  U  {+»}  and  A  is  a  subset  of  X  .  We  refer  to  f  as  the 
minimized  function  (or  objective  function);  the  set  A  is  called  the  constraint 
of  (1.1),  and  if  A  =  X  ,  the  problem  is  said  to  be  unconstrained . 

It  is  common  to  write  (1.1)  in  the  form 

(1.2)  f(x)  —  inf  ,  X  €  A  ;  t 

and  we  shall  sometimes  follow  this  convention. 

An  element  x^  of  A  is  said  to  be  a  solution  of  (1.1),  if  there 

exists  a  neighborhood  Q  of  Xq  such  that  f(XQ)  s  f(x)  for  x  in 

An  Q  .  The  set  of  all  the  solutions  of  (1.1)  is  denoted  by  R(f,A,(X,  t)  )  . 

Note  that  a  solution  of  (1.1)  corresponds  to  a  local  minimum  (with  respect 

to  T  )  in  distinction  from  a  (global)  minimum  (i.e.  an  element  of  A 

such  that  {(Xq)  -  f  (x)  for  each  x  in  A  .)  Observe  that  if  Tj  ^  , 

then  a  solution  of  (f,A,(X,Tj))  is  also  a  solution  of  ( f ,  A,  ( X,  t^)  )  • 

The  number  inf  f(x)  is  called  the  Q  -value  of  (1.1)  (value,  if 
X  €  A  n  0 

0  =  X  ).  It  may  be  finite,  +  00  or  -  00  .  We  adopt  the  convention  that  the 
infimum  of  every  function  on  the  empty  set  is  +oo  . 

The  reason  for  introducing  the  new  terminology  is  two-fold.  Primarily, 
a  global  minimum  of  (1.1)  is  a  solution  of  (1.1)  for  the  chaotic  topology 


3 


1  =  {0,X)  ;  thus  the  definition  embraces  both  local  and  global  minima.  The 
theory  we  are  going  to  present  deals  with  solutions  and  it  is  immaterial  whether 
they  represent  local  or  global  minima.  Secondly,  the  topology  is  made 
explicit  in  our  definition,  in  order  to  avoid  the  confusion  than  can  arise 
otherwise*  . 

1.1  Example 

Let  ^0  ’  ’  ’  ‘ ' ^m  real-valued  functions  defined  on  a  set  X  and 
let  S  be  a  subset  of  X  .  Consider  the  problem 

fp  (X)  —  inf  ,  T 

X  €  S 

(1.3) 

f^  (x)  =  0  i  =  1 ,  • .  •  ,  p 

fj  (x)  s  0  i  =  p+1 ,  •  • .  ,  m  . 

Here  f^  is  the  objective  function,  while  the  constraint  is 
A  =  {x  :  fj(x)  =  0  ,  i  ^  p,  f^(x)  s  0,  i  >  p}  n  S  .  Frequently  the  set  S 
is  called  the  nonfunctional  constraint  of  (1.3)  and  the  functions  f^  , 
i  =  1 ,  •  •  •  ,  m  are  said  to  define  the  functional  constraints  at  (1.3),  more 
specifically  equality  constraint  for  i  ^  p  and  inequality  constraints  for 
p+1  s  1  s  m  . 


A  typical  example  is  that  of  (local)  strong  and  weak  minima  in  the  calculus  of 
variations.  The  first  refers  to  the  topology  of  uniform  convergence,  the  second 
to  the  Sobolev  topology  of  uniform  convergence  together  with  first  derivatives. 
The  notions  h-ive  nothing  to  do  with  strong  and  weak  topologies. 


Presumably,  the  above  notions  make  a  mathematician  feel  uneasy 
because  of  their  lack  of  precision.  Already  the  distinction  between  functional 
and  nonfunctional  constraints  is  quite  vulnerable,  as  every  set  S  may  be 
represented  by  {x  :  Xg(x)  s  o}  (or  by  {x  :  Xg(x)  =  O}  )  ,  where  Xg 
is  the  characteristic  function  of  S  .  Similar  weaknesses  can  be  seen  in  the 
distinction  between  equality  and  inequality  constraints  (an  equality  constraint 
can  be  represented  as  two  inequality  constraints). 

What  makes  the  discussed  notions  valid  is  that  they  do  not  refer  to  the 
constraint  but  to  how  it  is  represented. 

Let  r  be  a  multifunction  from  a  set  Y  into  subsets  of  X  ,  yQ 
an  element  of  Y.  A  couple  (r,yQ)  is  a  constraint  refyesentatlon  of  (1.1), 
if 

A=  ryQ  . 

The  set  Y  is  called  the  index  set  (parameter  set),  its  elements  are  indices 
(parameters). 

1.2  Example 

Let  Y={0,1}.  We  define  rl  =  A  and  rO  =  X\A.  (r,l)  is  a 
constraint  representation  of  (1.1).  The  inverse  multifunction  r"^  maybe 
seen  as  the  answer  to  the  question ;  Is  x  in  A  ?  By  setting  1  =  yes , 

0  =  no  we  obtain  an  answer  in  each  case  by  looking  at  x  . 

1.3  Example 

Let  ^1*  •  •  •  «  be  real-valued  functions.  Consider  the  set 
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m  X 

To  represent  this  set  we  may  choose  the  multifunction  r  ;  R  —  2  : 

r(ri ,  •  •  • ,  rj^)  =  {x  ;  (x)  £  r^  ,  1  =  1 ,  •  •  • ,  m} 

and  an  index  (0  ,  •  •  •  ,  0)  .  But  there  are  many  other  possibilities  ,  for  instance 
A  :  F  -  2^  : 

(1.4)  Ar={x;  max  f,  (x)£r} 

Isism 

and  rQ  =  0  .  Another  representation  may  be  that  of  the  previous  example. 

A  minimization  problem,  as  it  is  posed,  includes  a  constraint  representa¬ 
tion.  This  is  also  true  about  problems  given  in  the  form  (1.1),  where  the 
representation  is  simplest  (that  of  Example  1.2). 

The  specific  representation  is  the  way  in  which  a  problem  was  presented 
to  us ,  or  a  way  of  our  comprehension  of  the  problem.  It  may  reflect  the  form 
under  which  a  problem  arises  from  the  previous  mathematical  considerations  or 
the  mathematical  model  of  a  physical  process. 

We  may  loosely  say  that  our  access  to  the  space  X  is  indirect,  via 
the  space  Y  on  which  a  constraint  representation  is  defined.  The  question 
whether 

X  €  ryQ 

amounts  to  the  question  (now  in  the  space  Y  )  whether 


This  idea  has  a  numerical  aspect.  If  we  consider  the  multifunction  r  of 
Example  1.3,  then  we  observe  that  r  =  (fj  (x) ,  •  •  •  ,  fjjj(x) )  +  R™  .  Each 
element  x  of  X  is  represented  as  an  m  -tuple  of  reals  in  Y  .  In  order 
to  see  if  x  belongs  to  r(rj,  •  •  •  we  need  only  check  whether 

f^  (x)  ^  r^  ,  for  i  =  1 ,  •  •  •  ,  m  . 

Let  (F.Yq)  be  a  constraint  representation  of  (1.1).  The  quadruple 
(1-5)  (f,r,yQ,(X,T)) 

is  called  a  problem  representation  (of  (1.1)  relative  to  (F.Yq))  • 

As  we  shall  see,  some  representations  are  more  convenient  than  others. 
In  some  circumstances  one  may  wish  to  change  a  given  representation  to  another 
more  convenient  under  some  aspect. 

Let  a  multifunction  r  :  Y— 2  and  y^  in  Y  define  a  constraint 
representation  of  (1.1)  .  Let  B  be  a  family  of  subsets  of  Y  such  that 

r^xcB  ,  xeX. 

Consider  a  multifunction  E  from  a  set  Z  into  (subsets)  of  Y  . 

1.4  Proposition. 

Let  (TtYg)  be  a  constraint  representation  of  (1.1)  .  If  there  exists 
Zq  in  E  ^  Yq  such  that  Zq  /  E  ^  J  for  every  set  B  from  B  with 
Yq  /  B  ,  then  (  FE,  z^  )  is  a  constraint  representation  of  (1.1)  . 


I 

/.  ^ 
I 

j 
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Proof 

We  need  proof  that  F  E  =  Fy^  .  Since  y^  «  E  Zq  ,  Fy^  C  F  E  Zq  . 

Assume  that  x  is  not  in  FyQ  ,  equivalently,  y^  is  not  in  F  ^x  , 
tiias  by  our  assumptions 


Zq  is  notin  E  ^F  ^x  and,  equivalently,  x 


0 


is  not  in  F  E  z 
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•w*. 


1.5  Example 

Consider  T  from  Example  1.3.  The  sets 
r"^x  =  (f,  (x),  •  •  •  ,  fj^(x) )  +  belong  to  the  class  ft  =  {y  +  R™;  y  «  Y  (=  F*")} 

Let  Z  =  F  and  let  E  :  F  —  2*^  be  defined  by 

E  r  =  {  (r^ ,  •  •  •  ,  r^jj)  :  r^  ^  r  ,  1  =  1 ,  •  •  •  ,  m}  . 

Then  (A,0)  ,  A  =  TE  (1.4),  is  a  representation  of  the  constraint 

A  =  r  0  .  Indeed  ,  the  multifunction  E  ^  (r, ,  •  •  •  ,  r  )  =  max  r.  +  F , 

^  ^  l:£i£m  ^ 

has  the  property  required  in  Proposition  1.4. 

Observe  that  if  k  :  Z  —  Y  is  one-to-one ,  then  E  given  by 

Ez  =  {(c(z)} 

satisfies  the  assumptions  of  the  proposition. 

Let  (X,  t)  ,  (Z,  7T)  be  topological  spaces  and  let  n  :  Z  —  2  . 

A  point  (Zq,Xq)  from  Q(n)  is  called  a  singular  point  of  fi  ,  if  there  is 
a  neighborhood  Q  of  Xq  such  that  Zq  is  a  boundary  point  of  n  . 

1. 6  Proposition 

A  point  (Zq,Xq)  is  a  singular  point  of  n  ,  if  and  only  if  n  is 
not  lower  semicontlnuous  at  (Zq.Xq)  . 

Proof 

It  is  enough  to  reformulate  the  definition  (keeping  in  mind  that  Zq 
is  always  in  n  )  :  there  is  a  neighborhood  Q  of  Xq  such  that  for 
each  neighborhood  W  of  yp 
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w  . 

This  is  Just  contrary  to  lower  semicontinuity  at  (Zq,  Xq)  . 

1.7  Corollary 

Let  be  topologies  of  X,  ^opolo^ies  of  Z  such  that 

T  <  'T  TT  >  TT 

Ti  -  ''  1  -  2  • 

y 

Let  n  :  Z— 2  and  assume  that  (Zq.Xq)  is  a  singular  point  of  n  with 
respect  to  (n ^ ,  Xj)  ,  then  it  is  singular  with  respect  to 


F?g.  1.1.  Singular  points  of  n 

y 

Let  (r,  yg)  (where  T;  Y— 2  )  be  a  constraint  representation  of 
(1.1)  .  The  multifunction  ^  :  Y  x  R  2^  : 


(1.6) 


^f,  -  r) 


is  called  the  associated  multifunction  of  (1.5)  .  The  inverse  multifunction 


satisfies 

(1.7)  X  =  r”^x  X  {r  :  f  (x)  s  r}  . 

Remark 

-1  -1 

If  ^  and  (y.rpen^  x  ,  then  ^x. 

1.8  Example 

m— 1  ^ 

Consider  the  problem  (f^^ ,  rO ,  (X,  t)  )  where  F:  F  —2  is 
defined  as  ^  »  '  "  » ’  f^(x)^r^,  i=l,***,m-l}  (see 

Example  1.3).  The  associated  multifunction  n  satisfies 

_  X  =  (f,  (x) ,  f2  (x) ,  •  •  •  ,  f  (x) )  +  . 

Let  a  be  a  topology  of  Y  and  v  be  the  natural  topology 

of  F  . 

We  say  that  an  element  Xq  is  an  extremal  (of  the  problem  representation 
(1.5))  with  respect  to  a  ,  if  (yQ  ,  f  (Xq)  ;  Xq)  is  a  singular  point  of  the 
associated  multifunction  n,  with  respect  to  (aXv.r)  . 

1.9  Example 

Consider  the  problem  of  Example  1.9.  Let  a  be  the  natural  topology 

-  _,m-l  _ 

of  F  .  Denote 

f(x)  =  (f^(x),f2(x),  •••  ,f^(x))  . 

An  element  Xq  is  an  extremal,  if  there  is  a  neighborhood  0  of  Xq  such 
that  f,(XQ)  is  on  the  boundary  of  ^+*  • 
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Note  that  a  sufficient  condition  for  Xq  to  be  an  extremal  is  that  the 

sets 


f  (Xq)  -  Int  ,  f  (Q) 


Indeed,  the  condition  means  that  for  each  4  =  (4, ,  •  *  •  ,  |  )  such 

/Nj  i  m 

that  4j>0,  i=l,2,*'*,m, 

f(XQ)  /  f(Q)  +  I  .  If  Xq  were  not  an  extremal ,  then  for  some  e  >  0 

and  each  lU  II  <  e  .  X (Xq)  -  c  f  (0)  +  K+  •  Let  h  =  .  •  *  *  . 

be  such  that  ti.  >0,  i=l,2,**',m.  Consequently  there  is  a  4  in 

m  ~ 

R^  and  an  x  in  Q  such  that 

f(x^)  =  f  (x)  +  4  +  T1  . 

By  setting  4  =  4  +  n  we  arrive  at  a  contradiction. 

^ 

Let  {r,yp  be  e  constraint  representation  of  (1.1),  where  r  is  a 
multifunction  from  a  toj^jlogical  space  ( Yj ,  into  (X,  t)  .  Consider  a 
multifunction  E  acting  from  a  topological  space  (  ,  o^)  such  that 

(1  E.y^),  y^  in  Y^  ,  is  another  constraint  representation  of  (1.1) 

(see  Prop.  1.4). 
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1.10  Proposition 

Suppose  that  E  is  lower  semicontinuous  at  (72, y^)  •  If  Xq  is  an 
extremal  of  (f,  FE,  72,  (X,  t))  ,  then  it  is  an  extremal  of  (f ,  r ,  ,  (X,  t)  )  . 

Proof 

It  is  enough  to  show  that  if  the  associated  multifunction  p  fs 
lower  semicontinuous  at  (y^ ,  f  (Xq)  ,  Xq)  ,  then  the  multifunction  fij  Pj.  is 
lower  semicontinuous  at  (y2  ,  f  (Xq)  ,  Xq)  . 

Assume  the  former  and  let  Q  be  a  neighborhood  of  Xq  .  There  are 
a  neighborhood  of  yj^  and  an  e  >  0  such  that 

(1.8)  3  y  6  r  ^x  ,  r  >  f(x)}  Wj  X  (f(xQ)- e,oo)  . 

^  ^  X  €  Q 


By  the  lower  semicontinuity  of  E  there  is  a  neighborhood  of  such 

that  e'^W^  D  W2  .  The  set  x  (f  (Xq)  -  e.oo)  is  a  subset  of 


f 

,  TE 

Indeed ,  let  z  be  in 

W2 

and  r  >  -  e  . 

Then  there  is  a  y 

in 

Wj^  such  that  z  is  in 

E~V 

.  On  the  other  hand , 

by  (1.8)  there  is  an 

X 

in  0  such  that  y  is  in 

r" 

^x  and  r  =  f  (x)  . 

Observe  that  the  multifunction  E  of  Example  1.5  is  everywhere  lower 
semicontinuous . 

The  sense  of  Proposition  1.10  is  that  the  change  of  a  constraint 
representation  with  the  aid  of  a  lower  semicontinuous  multifunction  E  does 
not  increase  the  set  of  extremals. 
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1. 11  Proposition 

An  element  Xq  Is  a  solution  of  (1.1)  ,  if  and  only  if  it  is  an  extremal 
of  a  problem  representation  (1.5)  of  (1.1)  with  respect  to  the  discrete  topology 
of  Y  . 

Proof 

Note  that  the  family  {{y^}  x  (f  (Xq)  -  e,  f  (Xq)  +  e),  e  >  O}  forms  a 
neighborhood  basis  of  (yQ»f(XQ))  in  Y  x  R  in  the  considered  topology. 

Suppose  that  Xq  is  an  extremal :  there  is  a  neighborhood  Q  of 
Xq  such  that  for  each  e>0,  {yQ}  x  (f  (Xq)  -  e .  f  (Xq)  +  e)  Q  . 

Let  X  be  in  PyQ  n  Q  .  Consequently  yQ  is  in  r”^x  and,  by 
(1*7)#  (yQ,f(x)  )  is  in  •  By  what  we  have  Just  said  and  by  Remark 

f (Xq)  -  e  <  f(x)  for  each  e  >  0  ,  thus  Xq  is  a  solution. 

Suppose  now  that  Xq  €  PyQ  is  not  an  extremal,  that  is,  for  each 
neighborhood  Q  of  Xq  there  is  r  <  f(xQ)  such  that  (Yq  ,  r)  €  (2~^Q  . 
Therefore  there  is  an  x  in  Q  such  that  r  s  f(x)  and  yQ  <  r“^x  . 

In  other  words  f(x)sr<f(xQ)  and  x  is  in  Q  n  PyQ  .  The  element  Xq 
is  not  a  solution. 

In  view  of  Corollary  1.7  we  have 

1.12  Corollary 

Let  (r,yQ)  be  a  constraint  representation  of  (1.1)  and  let  o  be 
any  topology  of  Y  .  If  Xq  is  a  solution  of  (1.1),  then  it  is  an  extremal 
of  (1.5)  with  respect  to  a  . 

Here  is  an  example  of  an  extremal  which  is  not  a  solution.  Let 

2 

X  =  R  and  t  be  its  natural  topology.  Consider  the  problem 


2 

and  the  constraint  representation  ({(Xj,X2):  Xj  ^  r}  ,  0)  ,  rt  R,  R  with 
its  natural  topology.  Then  (0, 0)  is  an  extremal  but  not  a  solution. 
Conversely  it  is  natural  to  ask  when  an  extremal  with  respect  to  a  given  topology 
a  is  a  solution.  Before  providing  an  answer  to  this  question  we  shall 
Introduce  the  notion  of  value  function. 

A  constraint  representation  (r,yQ)  ,  r  :  Y  —  2  of  a  problem  (1.1) 
gives  rise  to  a  class  of  minimization  problems ,  namely 

(f,  Ty,  (X,  T))  ,  y  €  Y  . 

Sometimes  these  problems  are  called  perturbed  problems  of  (1.1)  .  They  are 
indexed  by  elements  of  Y  (index  set).  The  function  fTp  defined  on  Y 
by  the  rule : 

(1.9)  fr  (y)  =  inf  f(x) 

^  X  €  Ty  n  Q 

is  called  the  Q  -value  function  of  (1.5)  (Q  -primal  functional, 

Q  -perturbation  function).  When  Q  =  X  ,  it  is  called  the  value  function 
and  is  denoted;  fr  .  It  is  known  [1] 


1.13  Proposition 


The  epigraph  of  f  Tg  is  equal  to  the  closure  of  pQ  in  the 
product  of  the  discrete  topology  of  Y  and  of  the  natural  topology  of  R  . 
The  only  elements  that  can  belong  to  epl  fTg  but  not  to 
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(1-10)  (y.frQ(y)) 

An  element  (1.10)  belongs  to  n  ^  0  ,  if  and  only  if 

f » r 

in  Q  n  Fy  . 


f  attains  its  minimum 


It  is  an  immediate  observation,  that  Xq  is  an  extremal  with  respect 
to  a  ,  if  and  only  if  there  exists  a  neighborhood  Q  of  Xq  such  that 
(yQ,f(XQ))  is  a  boundary  point  of  epi  fr^  . 

We  may  now  answer  the  question  we  have  posed.  Let  (F,  yQ)  be  a 
constraint  representation  of  (1.1)  .  We  fix  a  topology  a  of  Y  . 

1.14  Proposition 

Let  Xq  be  an  extremal.  If  there  is  a  neighborhood  basis  B(Xq) 
of  Xq  such  that  for  each  Q  e  RIXq)  the  Q  -value  function  is  upper 
semicontinuous  at  yQ  ,  then  Xq  is  a  solution  of  (1.1)  . 

Proof 

Suppose  that,  on  the  contrary,  Xq  is  in  FyQ  but  is  not  a  solution 
of  (1.1).  It  follows  that  for  each  Q  «  B(Xq)  ,  e(Q)  =  ^(Xq)  -  fFp(yQ)  >  0  . 
By  upper  semicontinuity  there  is  a  neighborhood  W  of  yQ  such  that  for  each 
y  in  W 

Therefore  (yQ,f(xQ))  is  an  interior  point  of  epi  f Fq  for  each  Q  in 
B(Xq)  .  This,  in  view  of  Proposition  1.  6  contradicts  the  assumption  that  Xq 


is  an  extremal. 
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We  infer 

1.15  Corollary 

Let  f  be  upper  semicontinuous  in  a  neighborhood  of  Xq  .  Assume 
that  r  is  lower  semicontinuous  at  (x.Yq)  for  x  in  Typ  and  from  a 
neighborhood  of  Xq  .  If  Xq  is  an  extremal,  then  it  is  a  solution. 

1.16  Example 

Let  r  be  as  in  Example  1.9  and  assume  that  X  =  R*'  with  its 
natural  topology  t  .  Suppose  that  are  continuously 

differentiable  at  Xq  .  We  shall  show  later  (Corollary  )  that  if 

(fl’  (Xq)  .  •  •  •  .  Vl  (Xq)  )  X  +  =  R”'"^  . 

then  r  satisfies  the  assumptions  of  Corollary  1.15. 

Proposition  1.13  offers  precious  information  for  analysis  of  minimization 
problems.  It  provides  a  geometrical  interpretation  (in  the  space  Y  x  R  ) 


Fig.  1.3.  Epigraph  of  a  Q  -value  function,  when  its 

2 

domain  is  a  one-dimensional  manifold  in  R  . 


If 


of  extremality  and  minimality. 

We  are  going  to  indicate  how  this  Interpretation  helps  to  draw  some 
interesting  conclusions  from  general  theorems.  Take,  for  instance. 

Proposition  1.14. 

1.17  Example 

Suppose  that  the  space  Y  of  indices  is  given  together  with  a  topology 
p  (for  instance  a  Banach  space  with  its  strong  topology). 

If  it  happens  that  the  domain  of  a  constraint  representation 

dom  r  =  {y  :  Ty  /  )3  } 

is  a  boundary  set  in  Y  ,  then  every  element  x  (of  Fy^)  is  an  extremal 

with  respect  to  the  topology  p  (this  follows  from  the  convention  that 

inf  f(x)  =  +00  ,  whenever  Fy  =  0  )*  .  It  is  useful  to  introduce  in 
X  e  Ty 

Y  a  topology  o  in  the  following  way : 

Induce  the  topology  p  on  Z  =  dom  r  (a  set  A  C  Z  is  open, 
whenever  there  exists  an  open  set  B  for  p  such  that  A  =  Z  n  B  )  .  Let 
a  consist  of  all  the  open  subsets  of  Z  and  of  the  set  Y\Z  . 

Proposition  1.14,  specialized  for  thus  constructed  topology  claims 
that,  if  Xq  is  an  extremal  (with  the  index  space  dom  r),  and  if,  for  a  basis  of 
neighborhoods ,  {q}  of  Xq  ,  the  Q  -value  functions  f  Tg  are  upper 
semicontlnuous  on  dom  r  ,  then  Xq  is  a  solution. 

*  u 

Such  a  situation  occurs  in  a  Banach  space  when  dom  r  is  a  manifold 
(of  nonzero  co-dimension). 
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1.18  Corollary 

Suppose  that  there  Is  a  neighborhood  Q  of  Xq  such  that  f  is 
upper  semicontinuous  in  Q  .  Assume  that  r  is  domain  lower  semicontinuous 
at  (x.Yq)  for  each  x  in  Q  n  .  Then,  an  extremal  of  (1.5)  with 

respect  to  cr  ,  is  a  solution  of  (1.1). 

A  legitimate  question  at  this  moment  is,  why  not  choose  as  an  index 

space  the  effective  domain  ;  F  X  rather  than  all  of  Y  . 

The  motivation  for  staying  with  Y  is  two-fold.  First,  when  knowing 
F  it  may  be  difficult  to  precisely  describe  F  ^  X  .  Secondly ,  Y  is 
usually  chosen  to  enjoy  a  rich  structure,  which  may  not  be  shared  by  its  subsets. 

The  former  reason  is  linked  with  the  controllability  theory ,  where 
frequently  it  is  very  hard  to  determine  what  F  ^  X  is. 

We  say  that  a  multifunction  F  :  Y— 2^  is  controllable ,  if 

f"^  X  =  Y  . 

If  ( Y,  o)  is  a  topological  space,  we  say  that  F  is  (locally) 
controllable  at  Yq  ,  if  there  is  a  neighborhood  W  of  y^  such  that 

f"^  X  r>  W  . 

Notice  that  controllability  at  y^  amounts  to  lower  semicontinuity  of  F 
at  (yo,x)  (for  each  x  in  X  )  with  respect  to  the  chaotic  topology  of 

X  . 

Controllability  is  lower  semicontinuity  with  respect  to  the  chaotic 


topology  in  both  X  and  Y  • 
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2 .  Interlude 

Consider  a  standard  minimization  problem  (1.1)  : 

(2-1)  (f.A,(X,  T))  . 

Denote  by  the  topology  induced  from  (X,  t)  on  A  and  consider  as 

well  the  problem 

(f.A,(A,T^))  . 

In  the  terminology  of  the  previous  section,  the  latter  problem  is  unconstrained. 
One  easily  observes  that  (2.1)  and  (2.2)  are  equivalent  in  the  sense  that 
their  sets  of  solutions  are  equal 

R(f.A,(X,T))  =  R(f,A.(A,T^))  . 

Formally,  there  is  no  reason  to  consider  (2.1),  as  all  Information  about  what 
the  problem  consists  of  is  given  by  (2.2).  On  the  other  hand ,  given  (2.2) 
there  are  many  ways  of  "embedding"  it  into  problems  of  type  (2.1)  . 

The  motivation  in  formulating  problems  in  the  form  (2.1)  is  that  the 
space  (X,  t)  is  usually  nicer  than  (A,  )  .  "Nicer"  in  terms  of  a  richer 

structure  of  ( X,  x  )  (e.g.  Banach  space,  analytic  manifold,  etc.)  that 

enables  us  to  use  mathematical  tools  that  have  been  developed  for  such  structures. 

The  above  thought  inevitably  entails  another  one :  Why  not  try  to  replace 
(2.1)  by  an  unconstrained  problem  on  (X,  x)  ,  say 

(^•^)  (L,X.  (X,  X)  )  , 

and  use  precise  tools  available  in  the  space  (X,  x)  to  solve  it  ?  But  be 
cautious  !  The  function  L  in  (2.3)  must  be  nice  too;  otherwise  it  will 
resist  precise  tools. 


We  are  concerned  first  with  the  replacement  of  (2.1)  by  (2.3)  in  the 
following  sense;  Let  Xq  be  a  solution  of  (2.1)  .  Find  L  so  that  Xq 
is  also  a  solution  of  (2.3)  . 

Let  (T.Yq)  :  Y— 2^  be  a  constraint  representation  of  (2.1)  and  let 
a  be  a  topology  of  Y  .  Consider  the  scheme ;  Let  Xq  be  an  extremal  of 
(1.5).  Find  L  so  that  x^  is  a  solution  of  (2.3). 

If  we  are  able  to  reach  the  latter  goal ,  then  in  view  of  Corollary  1.12 , 
we  shall  also  achieve  our  original  objective.  So  the  resulting  problem  ( (2.3) ) 
will  constitute  a  necessary  condition  for  solutions  of  the  problem  (2.1)  . 

The  role  of  the  concept  of  extremal  reveals  on  the  occasion  of  the 
described  replacement. 

The  inverse  of  the  associated  multifunction  (1*7)  completely  charac¬ 
terizes  (from  the  point  of  view  of  optimization)  the  points  of  X  ; 


whenever  x  belongs  to  the  constraint  y  and  f(x)  ^  r  .  As  we  pointed  out 

in  discussing  the  role  of  constraint  representations  ,  we  face  a  minimization 

problem  from  the  space  Y  x  R  (  Y  -space  of  indices)  through  the  multifunction 

n  .Therefore,  our  intervention  (constructing  the  function  L  of  (2.3)) 
ff 

may  be  done  from  the  space  Y  x  R  . 

The  definition  of  extremal  and  Corollary  1.12  reflect  an  exceptional 
property  of  an  element  Xq  of  X  (being  a  solution)  in  an  exceptional  property 
of  the  image  of  Xq  :  (y^,  f(XQ) )  (being  a  boundary  point) .  Now  all  depends 
on  how  we  can  take  advantage  of  this  new  situation. 
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Let  X,Z  be  sets.  Consider  a  multifunction  n  :  Z  —  2^  and  a 
family  of  (finite)  real-valued  functions  on  Z  . 

The  Lagrangian  of  (fi  ,  >?  )  is  the  function  L  :  X  x  f  —  R 
defined  by 

(^•1)  L(x,4j)=-  sup  4j(z)  . 

X  €  n"^x 

3.1  Lemma 

Let  Q  be  a  subset  of  X  and  let  Xq  be  an  element  of  Q  . 

Suppose  that  Zq  from  n'^x^  and  from  satisfy 

(3.2)  4)q  (Zq)  >  (z)  for  Z€n~^Q  . 

Then 

(^•^)  -4j(2q)  =  L(Xq,  4;q)  r  min  L(x,»J;q) 

X  €  Q 

f*roof 

It  follows  from  (3.2)  that  for  each  x  in  Q  ^  ~  4'q(z)  . 

thus  in  view  of  (3.1)  z  «  n  ^x 

(^•^)  -<\>q(Zq)  £  L{x,^\)Q)  for  xcQ  . 

In  particular  for  x  =  Xq  (3.4)  yields 

z  €  n‘^XQ 


4-0  (z)  >  4,q(Zq) 
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thus  L(Xq,4>q)  =  -4^q(Zq)  plugged  in  (3.4)  becomes  (3.3). 

Let  T  be  a  topology  of  X  and  n  a  topology  of  Z  .  We  say  that 
n  has  the  t  -separation  property  at  Xq  ,  if  there  is  a  neighborhood  basis 
ft(xQ)  of  Xq  such  that  for  each  Q  in  6(Xq)  the  set  Q  is  f  -separated 
with  respect  to  rr  (see  [1]  ). 

3 .2  Proposition 

Assume  fi  to  have  the  'i'  -separation  property  at  Xq  .  Let 
(Zq  ,  Xq)  €  Q  (n)  be  a  singular  point  of  n  •  Then  there  is  a  in  f 

such  that  Xq  is  a  solution  of 

(3.5)  (L(-  ,4^q),X,  (X,t)) 

Proof 

By  singularity  there  is  a  neighborhood  Qq  of  Xq  such  that  Zq 
is  a  boundary  point  of  for  each  neighborhood  Q  C  Qq  of  Xq  .  By 

f  -separation,  for  Q  in  B(Xq)  and  Q  C  Qq  ,  there  is  a  4^0  such  that 
(3.2)  holds.  Hence  (3.3)  is  valid. 

3.3  Example 

Let  n  be  that  of  Example  1.9.  Let  f  be  the  class  of  all  linear 
forms  on  f"'  .  Then 

m 

T  =  {4i  :  vii(rj,  •••  ,rjj^)  =  (-Xj)r^  ,  e  K,  i=i,---,m}  . 

The  Lagrangian  for  this  case  is 

r 

j  Y  X.f.(x),  if  X,  ^  0,  i  =  1,  ...,m 
'1=1  ^  ^ 

L(x,Xj,X2  ,  •  •  •  ,X^)  = 

1—00  ,  otherwise  . 
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3.4  Example 


Consider  ft  from  the  previous  example  but  H  of  the  form 


?  =  :  4^(ri.  •••  =  -k  (^3^)^  .  k  >  0  , 


€  F  ,  i  =  1 , 2  ,  •  •  •  ,  m} 


The  Lagrangian  is 


111 

L(x,k,s^,  •••,s^)=  k^J]^  max^(f.(x)  -  s^.O) 


3.5  Example 


The  same  ft  as  before.  Now  T  is  the  class 


XSO,  k^O,  SjcF}. 


Then 


L(x,  k,  s^,  •  •  •  ,  Sjj^_^,X.)  =  Xf  (x)  +  k  ^  max^  (f  (X)- s  ,  0) 

i=  1  ^ 

This  Lagrangian  may  be  written  in  another  way.  By  denoting 


m-1  ,  m-l 


k  ^  (r,-s^)  =  k  2;  rf  +  ^  X^r 

1=1  i=l  i=l 


+  c  , 


we  get 


2 

L(x,k,Xj.X2,  •••  .Xjj^,c)=  +  k  2;^max 

n-1  \. 

+  ^  max  (-^  ,  £j(x) )  +  c  . 
'.=  1 


3 . 6  Example 

Again  n  as  before.  Let  ’?  be 

m-1 

f  =  {4.  ;  ^  (rj ,  •  •  •  ,  Tj^)  =  -  k  E  J  Tj  -  sj  . 

X>0,  ksO,  s^€P}  . 


m 

L(x.k,  s^,  •  ••  ,  Sj^)  =  Xfjj,(x)  +  k  max  (f^(x)  -  s^.O)  . 


Then 
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Y 

Let  Y^-*2  ,  i=l,2,'**,m  and  let  'F^  be  families  of  real-valued 

functions  on  for  1  =  1 ,  •  •  •  ,  m  .  Denote  by  the  Lagrangian  of 

» 'Fj^)  • 

Consider  the  multifunction  n  :  Yj  x  •  •  •  x  —  2^ 

m 

n(yi. 

and  the  family  f 

m 

4>(yi.---.ym)=  4>i(yi)  • 

Then  the  Lagrangian  of  (12,  F)  satisfies 

m  m 

L(x,  ^  ^  L(x,4>j)> 

1=1  ^  i=l  ^ 

For  instance  Example  3.3  is  of  this  type. 

We  are  now  concerned  with  Lagrangians  of  (S2  ,F)  ,  where  12  is  the 
associated  multifunction  of  a  problem  representation  (1.5)  and  F  is  a  family 
(of  functions  on  Y  X  R  )  of  type 

(3.6)  ^  =  {4^  :  4^  (y  f  r)  =  r  +  'P  (y)  ;  X  s  0  ,  «  $  }  , 


f  being  a  class  of  (finite)  real-valued  functions  on  Y  .  In  view  of  (1.7) 

(3.6)  the  Lagrangian  is  of  the  type  just  discussed  and  may  be  written 

(3.7)  L(x,  <p,X)  =  Xf(x)  -  sup  ^(y)  . 

y  €  r~^x 

The  term  -  sup  ^(y)  is  of  course  the  Lagrangian  of  (r,$)  . 
y  «  r"^x 
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Example  3.3,  3.5  and  3.6  are  of  the  considered  type.  As  a  consequence 

of  Proposition  3.2  we  have  the  following  necessary  condition  of  optimality. 

3 . 7  Corollary 

Suppose  that  the  associated  multifunction  of  (1.5)  has  the  -separation 
property  at  Xq  .  If  Xq  is  a  solution  of  (1.1)  ,  then  there  is  a  ijjQ  in  (3.6) 
such  that  Xq  is  a  solution  of  (3.5). 

Proof 

By  Corollary  1 . 12  ,  Xq  is  an  extremal,  that  is  (yQ  ,  f  (Xq)  ,  Xq)  is  a  singular 
point  of  n  .  By  Proposition  3.2  Xq  is  a  solution  of  (3.5)  for  some  4iq  in  'F  . 

For  Lagrangians  of  type  (3.7)  we  have  that 

(3.8)  inf  L(x.?),X)=  inf  ( X  f  r  (y)  -  <p  (y) )  . 

X  ^  Q  y  €  Y  ^ 

Indeed,  on  recalling  (1.9), 

inf  L(x,v),X)  =  inf  (Xf(x)+  inf  (~<p{y))) 

X  €  O  x  €  Q  _-l 

^  y  €  r  X 

=  inf  inf  {Xf{x)  -  <p(y)) 

X  €  Q  y  €  r”^x 

=  inf  (X  inf  f(x)  -  cp(y)) 
yeY  xcQfiry 

=  inf  (Xfr  (y)  -  ?>(y) )  . 
y  €  Y  ^ 

> .  8  Example 

Let  be  that  of  Example  1.9.  We  assume  that  X  is  a  normed 
space  and  that  the  functions  »  * '  ’  *  convex.  In  this  case  we  have 
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that 

R(fn,.ro,  (X,  T))  =  (X.Tq)) 

where  r  stands  for  the  natural  topology  of  X  while  Tq  =  (0,X)  denotes 
the  chaotic  topology.  Let  4'  stand  for  the  class  of  all  nonzero  linear  forms 
on  Ir”'  .  Q  has  the  4  -separation  property  with  respect  to  both  t  and 
Tq  .  As  a  consequence  of  Corollary  3.4  we  have  that  if  Xq  is  a  solution 
of  (f^ ,  ro ,  (X,  Tq)  )  ,  then  there  are  numbers  >  0  ,  •  •  •  ,  s  0  not 
simultaneously  equal  to  zero  such  that 

m  m 

Yj  X,  f  (x.)=  min  Y  (^)  • 

i=  1  ^  ^  ^  X  «  X  i=l  ^  ^ 

m 

Indeed,  there  exists  a  ^'^0 ^’^1  ’  *  *  *  ’ ’'^m^  ~  ^  such  that 

(3.9)  4jQ(fj(xQ),  •••  ,fj^(XQ))  s  i1;q(z),  for  z  t  n‘^Q  . 

We  infer  that  X^  ^  0  for  all  i  by  setting  in  (3.9) 

z  =  (fj(xQ),  •  •  •  ,  fjjj(xQ) )  +  I  in  (3.9)  for  all  |  from  . 

From  now  on  we  shall  assume  that  classes  $  that  occur  in  (3.6) 

satisfy 

(3.10)  lj.<p  +  c«$,  if^€$,  ^>0,  C€R. 

All  the  classes  of  Examples  3.3  through  3.6  have  the  property  that  p.?? 
is  in  ^  provided  that  p  >  0  and  <p  is  in  ^  .  They  acquire  the  property 

(3.10)  if  we  complete  them  by  setting 


Augmenting  the  class  §  in  this  manner  does  not  alter  the  'F  -separation 
property. 

Let  Xq  €  Tyq  where  r  is  that  of  (1.5)  .  We  say  that  a  problem 
representation  (1.5)  is  $  -normal  at  Xq  ,  if  there  are  a  neighborhood  Q 
of  Xq  and  an  element  <Pq  of  $  such  that 


(3.12) 


-f(XQ)  +  v>o(yo)  -  T  +  for  each  (y,r)en~  Q 


In  other  words  (3.12)  means  that  one  may  separate  Zq  =  (y^,  f(XQ) )  from 


n”  Q  by  a  4;„  of  type 


^n(Y,r)  =  -r  +  <j>f.(y)  . 


fc-  i(;Q(z)-Const 
(wQ.f(Vo)) 


t|»Q(z)  “const 


(y-yO 


'Fo(y,r)“  -  (y-yi) 


Fig.  3.2.  $  -normal  at  Xq  and  not  $  -normal  at  Vq  . 

The  class  f  of  Example  3.5. 
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Proposition 


If  a  problem  representation  of  (1.1)  is  $  -normal  at  Xq  ,  then  Xq 
is  a  solution  of  (1.1). 

Proof 

By  definition  (3.2)  (in  its  special  form  3.12)  holds.  By  Lemma  3.1 
f(Xo)  -  L(x,?>q,1) 

X  €  Q 

and  in  view  of  (3.8) 

(3.13)  (ir  (y)  -  <pQ{y)) 

y  €  Y  ^ 

from  which  f(XQ)  s  frQ(yQ)  ,  hence  Xq  Is  a  solution  of  (1.1). 

3 .10  Corollary 

If  a  representation  of  (1.1)  is  §  -normal  at  x^  ,  then  the  Q  -value 
function  is  f  -subdifferentiable  at  yp  .  Moreover,  if  <Pq  is  a  subgradient  of 
fTg  at  yQ  ,  then  the  corresponding  i|jq  satisfies 

(3.14)  0  =  i)jjj(yQ,  f(x^,) )  2  a^^^(z)  for 
Proof 

Indeed,  by  putting  f (Xq)  =  f Fg (y^)  in  (3.13)  we  get 

(3.15)  frg(yQ)  -  9»Q(yQ)  s  f  rg(y)  -  ^Q(y)  yeY  . 

Hence  f  ($(y)  =  <Pq  (y)  -  frg(yQ)  +  VQiVQ))  is  a  subgradient  of  fTg  at 
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So  far  we  have  related  unconstrained  minimization  of  Lagranglans  to 
weak  separation  of  boundary  points  of  n  ^  Q  with  the  aid  of  functions  from  f 

fr 

and  obtained  necessary  optimality  conditions. 

We  may  derive  analogous  conditions  without  appealing  to  the  existence 
of  solutions. 

In  the  case  when  solutions  do  not  exist  the  mentioned  results  are  no  longer 
necessary  conditions  for  optimality  but  still  provide  useful  information  about  the 
structure  of  the  problem. 

The  discussed  method  is  based  on  the  separation  of  boundary  points  of 

-1 

epi  fr_  rather  than  those  of  Q  Q  .  Proposition  1.13  reflects  the  advantage 
V  f  r 

of  this  approach. 

Analogously  to  Corollary  3.7  we  have 
3 . 11  Proposition 

Suppose  that  the  associated  multifunction  of  a  problem  representation  (1.5) 
has  the  F  -separation  property  at  Xq  .  If  f  rQ(yQ)  >  -oo  ,  then  there  are  a 
neighborhood  Q  of  Xq  and  a  of  the  form 

(3-16)  ^ 

such  that 

(3.17)  L(x,Xq,^  ) 

^  X  «  0 

=  inf  (Xgfr  (y)  -  <pQ(y))  . 

Proof 

Each  function  of  type  (3.16)  is  continuous  in  the  product  of  the  discrete 

and  the  natural  topologies ,  thus  sup  4jq  =  sup  i|>q  .  Let 

U~^^Q  epifr^ 

ft 

i\ 

L  . 
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^0  “  ^^0  ’  ^  'F -separation  there  is  a  i|jq  of  type  (3.16)  so  that 

(in  view  of  (3.1))  (3.4)  holds,  which  in  virtue  of  (3.8)  amounts  to  (3.17). 

The  counterpart  of  normality  is  strong  duality  which  consists  in  separating 
of  boundary  points  of  epi  f  1'^  by  elements  of  the  class 

$  X  1  =  (y,  r)  =  -r  +  v’(y)  ,  <p  c  #}  . 

We  say  that  strong  $  -duality  holds  at  (for  a  problem  representation  (1.5)  ) 

if  there  is  a  neighborhood  Q  of  Xq  such  that  the  point  (yo'^^Q^Vo^^ 
be  weakly  separated  from  epi  f  Fg  by  a  function  from  f  x  1  . 

Certainly  $  -normality  at  Xq  implies  strong  f  -duality  at  x^  . 

3 .12  Proposition 

Strong  $  -duality  holds  at  x^  ,  if  and  only  if  there  is  a  neighborhood 
0  such  that  the  Q  -value  function  is  #  -subdifferentiable  at  yQ  . 

A  function  <pQ  is  a  subgradient  of  f  Tg  at  y^  ,  whenever  x  1 
separates 

Proof 

Strong  f  -duality  at  x^^  means  the  existence  of  (p^  and  a  neighborhood 
0  of  Xq  such  that 

(3.18)  -f  I  g  (Vj^)  +  (y^)  >  -r  +  (|0q  (y)  for  each  (y ,  r)  «  epi  f  Fg  . 

(3.18)  is  equivalent  to 

(3*19)  f  Fg  (yQ)  -  (iPq  (y^)  <  f  Fg(y)  -  (Pq  (y)  ,  y«Y 

which  signifies  that  <pQ  is  a  subgradient  of  fFg  at  yQ  . 
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In  view  of  (3.8)  formula  (3.19)  is  equivalent  to 

(3.20)  L(x,<PQ.y)) 

^  X  «  0 

=  inf  (f(x)-  sup  <pQ(y)) 

^  Q  y  «  r'^x 

Frequently  we  useLagrangians  referred  to  a  point  (which  differ  from  those 
we  have  been  studying  so  far  by  a  function  depending  merely  on  'F  )  .  The  most 
important  is  Lagranglan  of  Kurcyusz  (of  a  problem  representation  (1.5)  with 
respect  to  i  )  • 

(3.21)  L(x,(>»,yQ)  =  f(x)  -  sup  <|i>(y)  +  <p(yo) 

y  €  r"^x 

It  is  an  immediate  observation  that  (see  (3.20)). 

3 .13  Proposition 

An  element  is  a  subgradien*  of  ^o  '  only  if 

(3.22)  frQ(yQ)=  inf  L(x,?>Q,yQ)  . 

^  X  «  Q 

Formula  (3.22)  enables  us  to  find  the  Q  -value  by  computing  the  Q -value  for 
a  single  unconstrained  problem. 

We  know  that  #  -subdifferentiability  implies  $  -convexity 

(more  generally  for  some  classes  of  sets  F  -separation  implies  F  -convexity^. 

We  say  that  weak  §  -duality  holds  at  Xq  if  there  is  a  neighborhood 
Q  of  Xq  such  that  (yo*frQ(yQ))  may  be  weakly  almost  separated  from 
epi  f  Fq  by  a  function  from  f  x  1  . 
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3 .14  Proposition 

Weak  $  -duality  holds  at  Xq  ,  if  and  only  if  there  exists  a  neighborhood 
0  of  Xq  such  that  the  Q  -value  function  is  $  -convex  at  yQ  . 

Ihroof 

By  definition  weak  $  -duality  holds  at  Xq  ,  whenever  for  some 
neighborhood  Q  of  Xq  and  for  each  e  >  0  there  is  an  element  ^  of 
§  such  that 

which ,  by  the  definition  ,  amounts  to  $  -convexity  of  f  Fq  at 

Xq  . 

3 .15  Proposition 

Weak  §  -duality  holds  at  ,  if  and  only  if  there  is  a  neighborhood 
Q  of  Xq  such  that 

L(x,9>.yn) 

^  <P  e  i  x€  Q  ^ 

where  L  is  the  Lagrangian  of  Kurcyusz  (3.21). 

Proof 

In  view  of  (3.8)  and  on  recalling  the  definition  of  the  Fenchel  transform  [2] 

inf  L(x,^,y  )=  inf  (f  r  (y)  -  ^(y)  +  ^(y  ) ) 

X  c  0  y  «  Y  ^  ^ 

■  -f  r*  (<»)  +  ^.(yQ)  . 

Therefore 

sup  inf  L(x,^,y  )=fr  (y  )  . 

fC§X€Q  ^  QO 
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By  the  Moreau- Fenchel  theorem  (  [2]  )  ,  fTg  =  fr*  ;  fr^  is 

i 

i  -convex  at  Yq  ,  whenever  frg{yQ)  =  f  rQ(yQ)  thus  in  view  of  Proposition 
3.14  the  proof  is  complete. 

Formula  (3.23)  enables  us  to  compute  the  Q  -value  of  a  problem  with 
a  priori  chosen  precision  by  computing  the  Q  -value  for  a  single  unconstrained 
problem. 

It  is  the  t  -separation  property  of  associated  multifunctions  that  makes 
possible  the  replacement  of  minimization  problems  by  unconstrained  minimization 
of  the  Lagranglan. 

The  resulting  optimality  conditions  (see  e.g.  Corollary  3 . 7 )  carry  the 
more  information  the  smaller  is  the  class  T  ,  what  is  due  to  the  existential 
qualifier  "there  is  a  4jq  in  T  "  .  Also,  classes  that  are  used  in  practice 
are  chosen  to  make  easy  the  computation  of  (3.1).  Consequently,  good  classes 
?  are  those  small  and  special. 

Therefore,  in  such  cases  ,  the  'F -separation  is  an  exceptional  property 
of  multifunction.  It  may  be  expected  that  in  the  overwhelming  majority  of  cases 
associated  multifunctions  will  miss  such  a  property. 

As  we  shall  see,  sometimes  a  change  of  representation  or  a  change  of 
the  class  F  will  be  sufficient  to  overcome  the  impasse. 


* 


Note  that  all  the  considered  concrete  associated  multifunction  of  the  type 


-1 

n  X 


3!(x)  +  C  ,  X  «  S 

0  ,  otherwise 


where  3  is  a  mapping  into  Z  and  C  is  a  closed  convex  one. 
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But  most  commonly  we  shall  need  substitute  the  associated  multifunction 
by  another  multifunction  enjoying  the  I'  -separation  property  and  preserving 
extremality . 

The  space  Z  is  considered  with  two  topologies  tt  and  7t_  . 

X  M 

X  Y 

Let  n  ;  Z  —  2  .  A  multifunction  n/+  .  ^  ;  Z  —  2  is  close  to  o  at 

if  the  lower  semicontinuity  of  q' 

^^0  ’  ^0^  with  respect  to  implies  the  lower  semicontinuity  of 

at  (Zq,Xq)  with  respect  to  . 

3.16  Proposition 

Let  n£p  be  the  associated  multifunction  of  (1.5)  and  let  nl  f/  \ 

(Vq  *  I  (^q)  »  ^q) 

have  the  f  -separation  property  at  Xq  (with  respect  to  )  and  be  close  to 

fifr  (yQ.  f(XQ),  Xq)  in  the  sense  of  (tTj.tt^),  where  x  v 

(product  of  the  topology  of  Y  and  the  natural  topology  v  of  R  ). 

If  Xq  is  a  solution  of  (1.5),  then  there  is  a  4)^  in  'H  such  that 

Xq  is  a  solution  of  (3.5)  where  L  is  the  Lagrangian  of  (n!  ft  \  \  1 5' )  • 

(Yq  »  i  '^Q'  *  ^0 

Proof 

Left  to  the  reader . 


3.17  Example 

Let  >  •  • '  .  fjj,  be  continuous  functions  on  a  Banach  space  X  and 
differentiable  at  Xq  .  Let  n:  r"'— 2  be  defined  by 


'■'m^  ■  -  ’"i  '  l=l,--*,m}  . 

Let  'i'  be  the  class  of  all  linear  forms  on  r"*  .  The  multifunction 


f2 


(fj(XQ),  •••  ''"m^  "  ^i  ~  ‘‘l  ’ 


i  =  1,  •  •  •  ,  m} 
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has  the  'H  -separation  property.  It  is  known  [1]  ,  that 


m 


(TT,  7T)  ,  TT  the  natural  topology  of  R  . 


We  wish  to  emphasize  that  the  multifunction  n'  .  was  chosen 

(Zq  '  ^0' 

for  a  given  (Zq  ,  Xq)  from  the  graph  of  n  .  In  many  applications  there  is  a 
routine  procedure  of  finding  close  multifunctions  (see  Example  3.17)  . 
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4.  Sufficient  optimality  conditions  ;  improved  necessary  optimality  conditions 

A  necessary  condition  for  Xq  to  be  a  solution  of  a  problem  (1.1)  with 
a  representation 

(4.1)  (f.r.YQ.  (X.T)) 

is  under  some  additional  hypotheses,  the  existence  of  a  4jq  in  a  class  f 
of  real-valued  functions  such  that  Xq  is  a  solution  of 

(4.2)  (L(.  ,4jq),X.  (X.T))  , 

where  L  is  the  Lagranglan  of  the  associated  multifunction  and  of  the  class  f  . 
Our  next  objective  is  to  compare  sets  of  solutions  of  (4.1)  and  (4.2). 

In  general  the  sets  of  all  the  solutions  of  (4.1)  and  (4.2) 

(4.3)  R  (f,  ryQ,  (X.  T))  .  R(L(.  ,4)q),X,  (X,T)) 

are  very  weakly  related. 

We  start  by  relating  some  subsets  of  (4.3)  ,  namely  the  sets 

(4.4)  R(f,  ryQ  n  Q,  (Q,  Tq))  ,  R  (L(  •  .  ijiQ) ,  0  .  (0  ,  Tq)  ) 

where  Q  is  an  open  set  and  Tq  Is  the  chaotic  topology  in  Q  . 

Let  L(x,^,X)  be  the  Lagranglan  (3.7). 


♦♦ 


See  Exercise  9 . 
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4.1  Proposition 


Suppose  that  there  is  a  neighborhood  Q  of  Xq  and  <pQ  in  f  such 


that  <pQ  is  a  subgradient  of  f  at  .  Then 


(4.5) 


R(f.ryQ  n  Q,  (Q,Tq))  C  R(L(-  (Q  ,  Tq)  ) 


Proof 


Let  X  belong  to  ft(f ,  FyQ  ,  (Q  ,  Tq)  )  ;  thus  x  is  in  Ty^  n  Q 


and  f(x)=frQ(yQ)  .  Consequently  for  each  function  in  $ 

/\  /\  /s 

f  (x)  -  <p(yp,)  S  f  (x)  -  sup  <p(y)  =  L(x,  <p,  1)  . 

-l/\ 

y  €  r  X 

On  the  other  hand,  by  (3.8)  , 


f(x)  -  <PQ(yQ)  =  f r  (y^)  -  9>Q(yQ)  =  inf  L(x,fl.Q,l)  . 


X  e  0 


Hence,  L(x,?»q,1)=  inf  L(x,<Pq,1) 

X  €  0 


Since  the  Lagrangian  of  Kurcyusz  (3.21)  differs  from  L(x,9)q,1)  by 
<^0  (Yq)  »  it  follows  from  (3.22)  that  if  x  is  a  solution  of 
(f,  PyQ  n  Q,  (0,  Tq))  and  <pQ  is  a  subgradient  of  f  Fp  ,  then 


(4.5) 


f(x)  =  f  rp(yQ)  =  L(x,9»Q,yQ) 


4.2  Proposition 


If  <Pf.  is  a  strict  subgradient  of  f  at  y«  and  if  all  r  x 


arc  singletons  ,  then 


(•1.6) 


»^(f>  ^Yq  ^  (QiTq))  =  R.(L('  ,i;f>Q,l),Q,  (0,  Tq)  ) 
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Proof 

In  view  of  Proposition  4.1  it  is  enough  to  prove  inclusion  r'  .  In  our 
case  the  Lagrangian  becomes 

L(x,?>,l)  =  f(x)  -  ?>(r"^x) 

-1  -1^1 
whereby  (r~^x)  we  denote  the  (only)  element  of  r  x.  Let  x  belong 

to  the  right  hand  side  of  (4.6).  If  x  is  in  Ty^  ,  then  (in  view  of  (3.8)) 

f(x)- 9>o(yo)=  L(x.,Pq.1)  ^  frQ(y)  -  ?»o(y).  y*Y 

X  €  Q 

thus  f(x)  ^  fr  (y^)  and  x  is  in  R  (f ,  Fy^  n  Q  ,  (Q  ,  Tq)  )  .  If  x  were  not 
in  Ty-Q  n  0  then  (denoting  {y}  =  r  x ) 

l(x..Pq,1)=  f(x)-  <Pq{y)  ^  fr^iv)  -  <PQ{y)  >  -  v^iy^)  • 

On  the  other  hand  ,  by  (3.8), 

inf  L(x,<Pq,1)  s  frQ(yQ)  -  ?>Q(yQ)  , 

X  «  0 

leading  to  a  contradiction. 

4.3  Proposition 

Suppose  that  all  the  sets  r  ^x  are  closed.  If  <Pq  is  a  decisive 
subgradient  of  f  at  yQ  and  if  for  each  x  in  Ty^  n  0 

(4.7)  ’ 

y  €  r~^x 

then  (4.6)  holds. 

Proof 

Let  X  belong  to  R  (L(' ,  <Pq  ,  1) ,  Q  ,  (Q ,  Tq)  )  . 
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If  X  is  in  Fyq  ,  then  by  (4.7)  the  thesis  is 

proved . 

Suppose  that  x  is  not  in  FyQ  .  The  set  r  ^  x  is  closed  not 
containing  y^  hence  by  decisive  subdifferentiability 


(4.8)  ^  (i^Qiy)  -  <pQ(y) )  • 

y  €  r”^x 

In  virtue  of  (3.8) 

L(x,  ?)q  ,  1)  =  f  (x)  -  sup  <iOo(y)-  (frQ(y)  -  ?»Q(y)) 

y  €  r  y  c  r  ^  X 


(4.9) 


s  inf  (f  (x)  -  (y)  ) 

y  €  r  X 

/S  ,/N 

=  f(x)  -  sup  'Pn  •  • 


Again  in  view  of  (3.8)  and  by  (4.8),  (4.9) 

inf  L  (x ,  sPq  ,  1)  <  f  r_  (Yq)  -  9Q{yQ)  <  L  (X  ,  (Pq  ,  1) 
X  «  0  ^ 


Recall  that  this  class  has  the  property  that  if  a  function  g  is 

$  -subdifferentiable  at  Yq  ,  then  there  are  and  Cq  such  that 


^0  ""  “'^0 1!  y  ■  yg  II 
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is  a  decisive  subgradient  of  g  at  .  For  this  <Pq  ,  (4.7)  is  always 

satisfied. 

Note  that  for  all  multifunctions  r  from  the  previous  examples  ,  the  sets 
r  are  closed. 

In  order  to  improve  the  necessary  optimality  conditions  (like  Corollary 
3.7)  we  Impose  further  requirements  on  the  4jq  from  f  used  for  separating 
Zq  from  . 

Namely,  we  require  that  4iQ  separates  essentially. 

This  avoids  trivial  separation  but  does  not  exclude  the  situation  where  the 
Lagrangian  is  constant  on  Q  . 

4.5  Example 

Let  f  be  a  linear  continuous  form  on  a  Banach  space  X  .  Consider 
the  following  pjroblem  representation 

(f,  {x  ;  -f(x)  y}  ,  0,  (X,  Tq)  )  . 

-1  2  ,  , 

The  associated  multifunction  satisfies  n  x=  (-f(x),f(x))  +  ,  each  point 

satisfying  the  constraint  is  an  extremal ,  and  its  image  may  be  separated  by  the 
function  4/q  (r^  >>^2^  ~  ~h~^2  ‘  boundary 

point  Zq  of  n 

i1;q(Zq)=  sup 

z  €  n"^x  z  €  n"  X 

but  the  corresponding  Lagrangian  is  null. 

Even  if  the  Lagrangian  is  constant  and  thus  if  the  corresponding  problem 
(3.5)  is  trivial,  it  may  provide  us  with  useful  information.  Take,  as  an 
example  Proposition  3.16  ;  The  Lagrangian  we  consider  is  that  relative  to  a 
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multifunction  close  to  the  associated  one  at  the  examined  point.  In  this  case 
(3.5)  becomes  the  condition  that  the  examined  point  should  satisfy. 

Essential  separation  may  be  performed,  in  some  cases,  with  the  aid  of 
regular  functions.  A  function  i|jq  is  called  regular ,  if  for  each  open  set 
Q  the  set  open. 

4.6  Proposition 

Suppose  that  a  set  A  has  a  nonempty  interior.  If  for  an  element  Zq 
of  A  and  a  regular  function  ijjQ  we  have  that 

v);o(Zo)=  sup  4)  (z)  , 

Z  €  A 

then  Zq  is  on  the  boundary  of  A  and  the  separation  is  essential: 

4-0  (Zq)  > 

z  €  A 


Proof 

Left  to  the  reader. 

This  proposition  applies  in  the  cases  where  n  has  a  nonempty 
interior.  In  Example  1.17  we  discussed  the  case  in  which  r~^  X  is  a 
boundary  set  in  Y  (hence  n  must  not  have  interior  points).  In  this 
case  one  may  require  that  the  separating  function  is  regular  when  restricted  to 
r"^X  X  R  . 

Note  that  a  class  T  of  type  (3.2)  is  composed  only  of  regular 
.nctions  ,  if  we  remove  the  subclass  {4*  :  4j  (y ,  r)  =  <?>  (y) ,  <p  is  not  regular  on  Y  } 

Let  :  Yj  -*  2  ,  i  =  1 , 2  ,  •  •  •  ,  m  be  multifunctions .  Define  the 

multlfuncticn  r  :  Yj  X  Y^  x  .  .  .  x  Y^j^  — 2^  by 
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(4.10) 


r(yi.y2.....yn,)=  r^y^  . 


Consider  now  a  constraint  representation  (r ,  y  )  of  a  minimization  problem 
(1.1),  where  r  is  of  type  (4.10). 

The  first  representation  of  Example  1.3  ,  and  many  other  representations 
we  shall  deal  with,  are  of  the  discussed  type. 

The  pairs  (r^ ,  y^) ,  •  •  •  ,  (Tj^ ,  y^j^)  are  called  components  of  the 
/\ 

representation  (r,  y)  . 

We  say  that  a  component  (r^.y^)  is  active  at  (Xq  «  Fy  )  , 

if  Xq  Is  a  boundary  point  of  . 

A  class  'F  is  of  type  (3.6)  where 

m 

*  ~  ^i^l 

and  for  every  i  ,  is  a  family  of  real-valued  functions  on  satisfying 
(3.10)  . 

4.7  Proposition 

Suppose  that  there  is  a  neighborhood  Q  of  Xq  such  that  (^,  f(xQ)) 
is  essentially  separated  from  Q  by  an  element  of  the  form 


(4.11) 


1^  (Tj  ,yj)  is  not  active  at  Xq  ,  then  there  is  a  neighborhood  0  of  Xq 


such  that  the  element  ib 


M (y^ .  • 


1/  j 


(4.12) 


separates  (y»f(xQ))  essentially  from  Q  . 


Proof 

Since  (r^.y^)  is  not  active  at  Xq  ,  there  is  a  neighborhood  Oc  Q 
at  Xq  such  that 

/s.  -1  ,  <S 

Yj  «  Tj  X  ,  for  every  x  €  Q  . 


By  our  assumption ,  for  each  x  in  Q 
m 


m 


-Xf(xQ)  +  Yj 

^  ~  ^  (Vi  .“••V  )*f2  X  "" 

'n'  '^m,r^  “fr 


m 


=  -Xf(x)  +  Y  sup 

i=l  -1 

y^*  r  "x 

m  ^ 

>  -Xf(x)  +  Y  s“P  ^i^^i^  * 

}JJ  yi<  r‘'x 


The  proof  is  complete. 

The  meaning  of  Proposition  4.7  is  that  by  ignoring  nonactive  components 
of  constraint  representation  we  may  but  improve  the  necessary  optimality  conditions 
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5.  Duality 

Necessary  conditions  for  the  optimality  of  Xq  discussed  in  Section  3 
assure  the  existence  of  a  function  4*0  such  that  Xq  is  a  solution  of  (3.5)  . 

It  turns  out  that  4;^  is  itself  a  solution  of  a  certain  minimization 
problem,  called  the  dual  problem. 

We  restrict  these  considerations  to  the  chaotic  topology  Tq  (to 
global  solutions)  and  thus  we  abbreviate  the  notation  e.g.  (f,A,  (X,  Tq)  )  =  (f»A)  . 
We  start  by  introducing  dual  multifunctions . 

Let  r  be  a  multifunction  from  Y  into  subsets  of  X  .  Given  a 
family  f  of  (finite)  real-valued  functions  on  Y  we  define  the  $  -dual 
multifunction  r*  (acting  from  into  subsets  of  *  )  : 

(5.1)  r*f={<p€f;  sup  <p{y)£-Hx),  X  €  X}  . 

y  €  r  ^  X 

An  equivalent  representation  is 

(5.2)  r*f={<pe9:  ^(y)  s  (-f)r(y)  ,  yeY}  . 


In  other  words  ,  the  set  r*  (-f)  consists  of  all  those  elements  of  *  that 
are  majorized  by  the  value  function  of  (f ,  Fy^)  . 

Indeed  we  have  that  the  condition  in  (5.1)  is  equivalent  to 


0  s  inf  (-f(x)  + 
X  (  X 


inf 

^-1 

y  e  r  X 


(-<p(y) ) ) 


=  inf 
x«  X 


inf  (-f(x)-?)(y)  ) 
y  €  r~^x 


=  inf  (  inf  (-f(x) )-^(y)  ) 
y  «  Y  X  e  Fy 


inf  ((-f)F(y)-^(y) ) 
y  €  Y 


which  amounts  to  the  condition  in  (5.2).  Certainly, 


(5.3) 


5.1  Example 

Let  X  and  Y  be  normed  spaces  and  let  f  denote  the  set  of  all 
affine  continuous  forms  on  Y  :  f  =  {?>  =  9»q  +  c  :  e  Y*  ,  c  «  R}  •  Let 

ry  =  A~^  (y) 

where  A  is  a  continuous  linear  operator.  In  view  of  (5.1)  for  any 
f  :  X  -  F 

(-f)  =  +  c  :  A*<Pq  (x)  +  c  f  (x)  ,  X  c  X }  . 

Notice  that  for  any  function  f  ,  r*  (-f)  =  r^(-oof)  . 


5.2  Example 

Let  C  be  a  closed  convex  cone  in  Y  .  Let 

Ty  =  {x  :  y  €  Ax  +  C  } 

and  take  f  from  Example  5.1.  We  have  that 


^(Ax),  if  .pn  *  C* 


sup  <p(y)  =  \ 
y  «  Ax  +  C 


+  00  I  otherwise  , 


thus 
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r^f  =  {?)q  +  c  : 


+  c  s 


-f , 


Consider  a  multifunction  A  acting  from  a  set  ^  of  real-valued 
functions  on  X  into  subsets  of  $  .  Since  the  set  X  may  be  viewed  as 
a  subset  of  the  real-valued  functions  on  ^  by  the  formula* 

x(f)  =  f(x)  ,  f  €  ^ 
we  may  consider  the  X  -dual  multifunction  of  A 


y 

(5.5)  A'^g  =  {x  :  sup  x{i)  ^  -g{<p)  ,  ?»  €  $  }  . 

4  e  A  <p 

The  restriction  to  Y  (viewed  as  a  subset  of  F*  )  is  denoted  by 


We  write  X  R*-*  .  Note  ,  that  two  different  elements  Xj ,  x^  may 
define  the  same  function  on  ^  .  This  happens  when  f(Xj)  =  f(x2)  for 


each  f  ( 
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We  are  now  in  a  position  to  give  meaning  to  the  X  -dual  of  the  $  -dual 
of  a  multifunction  and  its  restriction  to  Y  .  We  define 


(5.6) 


r$x_  ^ 


=  (r*)^ 

Y  Y 


where  ^  . 


5.3  Proposition 

The  X  -dual  of  the  i  -dual  of  a  multifunction  T  (restricted  to  Y  ) 
is  equal  to  the  i  -hull  of  r  : 

«Y 

(5.7)  =  co^r  . 

Y  * 

Consequently,  if  for  each  x,  is  § -convex,  then 


Proof 

By  definition ,  x  is  in  (r*^)y  ,  whenever 

(5.8)  sup  f(x)  s  -^(y)  for  each  ip  t  i  . 

f€  (r*)'^^ 

.  *  -1 

Now,  f  is  in  (r  )  ip  ,  whenever 

(5.9)  -  sup  ip(y)  >  f(x)  . 

y  e  r'^x 

The  supremum  of  all  these  real-valued  functions  f  that  fulfill  (5.9)  is  equal 

-  sup  ^(y)  ,  hence  condition  (5.8)  becomes 
y  €  r~^x 
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(5.10)  ^(y)  —  sup  9{z)  for  each  <p  «  $  . 

-1 

z  «  r  X 

By  definition  ,  (5.10)  amounts  to 

y  €  co_  r  ^  X 

♦ 

or  equivalently  x  t  co^  Ty  . 


5.4  Proposition 

Y 

Let  2  be  a  subset  of  .  If  the  Lagrangian  L(*,?>)  of  (r,§) 
is  ^  -convex  for  each  <p  in  i ,  then 

(5.11)  r  =  CO.  r  . 

Tv  * 


Proof 


§X 

By  definition  x  is  in  (r  )y  ,  whenever 

•Ty 


sup  ^  (x)  s  -^(y)  for  each  ^ 

i  -1 

I  «  (r  )  % 


A  function  4  is  in  (F  )  <p  ,  whenever 


(5.12)  L(x,9>)=-sup  ?»(y)  ^  |(x)  . 

y  «  r"^x 

By  the  ^  -convexity  of  the  Lagrangian  the  supremum  of  those  4  from  ^ 

that  fulfill  (5.12)  is  equal  to  -sup  ^(y),  thus  (5.10)  holds. 

y  €  r“^  x 


This  proves  the  proposition. 
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5. 5  Example 

A 

We  shall  consider  the  X  -dual  of  the  multifunction  r  from  Example 
5.1.  Observe  that  the  Lagrangian  of  (r,  $) 

L(x,<p)  =  -<p(Ax)  =  -A  <pQ  (x)  -  c 

is  ^  -convex  for  each  <p  ,  if  ^  is  the  class  of  all  continuous  affine  forms 
on  X.  Therefore,  in  view  of  Propositions  5.3  and  5.4, 


fX  §X 

r  =  r 

I'Y  y 


The  set 


$ -1 


(r^)  (<pQ+c)  =  {i  ^  Z.'  A%q(x)  +  c  <  -f(x),  xeX} 


=  {-A'v>q  -  c}  . 

$X 

According  to  the  definition,  x  is  in  r  y  whenever 

Ey 


-A  <Pq  (x)  -  c  s  -<Pq  (y)  -  c 

ifc 

for  each  <p^  in  Y  •  In  other  words ,  whenever  ^»Q(Ax-y)=  0,  9)^  c  Y 

fX 

or  Ax  =  y  .  This  means  that  r  =  r  .  This  follows,  of  course  from 

Cy 

Proposition  5.3  ,  since  all  r  ^x=  {Ax}  are  §  convex. 

Consider  a  problem  representation 


(5.13)  (f,r,yQ) 

where  r  :  Y^  2^  .  The  $  -dual  of  (5.13)  is  defined  as 

(-Yq  .  » -f) 


(5.14) 
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$ 

where  r  is  the  $  -dual  multifunction  of  r  .  The  X  -dual  of  (5.14)  is 

(5.15)  (f,  T^^.Yq)  . 

Let  L^:  §  X  XX  R^—  F  be  the  Lagrangian  of  Kurcyusz  of  (5.14) 
and  L:XX$XY  —  R  be  the  Lagrangian  of  Kurcyusz  of  (5.13). 

5. 6  Proposition 

The  following  equality  holds 

(5.16)  -L^(9),x, -f)  =  L(x,  (p.Yq)  . 

Proof 

By  definition 

L^((p,x,-f)  =  -yQ(^)  -  sup  x(g)-x(f)  , 

g  €  (r*)‘V 

thus  in  view  of  (3.21)  we  should  merely  show  that 

inf  (-g(x))=  sup  <p(y) 

$  -1  -1 

g  «  (r*)  f  y  €  r  X 

$  -1 

The  set  (F  )  <p  is  composed  of  all  these  real- valued  functions  g  on  X 

which  satisfy  sup  <;(> (y)  ^  -g  (x)  ,  thus  (5.16)  holds, 
y  €  r”^x 

5 . 7  Proposition 

If  (pQ  is  a  subgradient  of  f  F  at  y^  ,  then  it  is  a  solution  of 

(5.14). 
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Proof 

If  an  element  <pQ  is  a  subgradient  of  f  r  ,  then 

(5.17)  9>o(y)  ^  fr(y)  ,  ycY, 

in  other  words ,  recalling  (5.2),  is  in  r  (-f)  ,  and  if  for  all  <p  in 

(-f)  , 

(5.18)  <p{yQ)  ^  <pQ(yQ)  . 

Thus  <pQ  is  a  solution  (5.14). 

5.8  Proposition 

If  <pQ  is  a  solution  of  (5.14)  and  if  fr  is  $  -convex  at  yQ  , 
then  (Pq  is  a  subgradient  of  fr  at  . 

Proof 

Let  <pQ  be  a  solution  of  (5.14).  In  view  of  (5.18) 

sup  <p(yQ)  =  <PQ(yQ)  and  by  $  -convexity  of  fr  at  yg  ?»o  ^^0^  ~  ^^0^ 

^  ^  f  r 

which  together  with  (5.17)  completes  the  proof. 

Certainly,  the  above  propositions  may  be  applied  to  establishing  the 
relationship  between  solutions  of  (5.15)  and  the  subgradients  of  (5.14). 
However,  such  results  seem  to  be  of  little  practical  value,  because  of  the 
difficulty  in  interpreting  what  X  -subdlfferentlabillty  ( X  -convexity)  of  the 
value  function  of  (5.14)  means. 

Instead ,  we  present 

5.9  Lemma 

If  fr  is  ♦  -convex  at  y^j  and  Xq  is  a  solution  of  (5.13), 
then  Xq  Is  a  subgradient  of  the  value  function  of  (5.14)  at  -f  . 
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Proof 

The  value  function  of  (5.14)  may  be  represented  by 

(5.19)  (-yn)r^(-g)=  (-?’(yo))  =  -(gr)^(yQ)  . 

^  <  gr 

By  §  -convexity  of  f  r  at  Yq 

(-yo)r^(-f)=  -fr(yo)  . 

Therefore,  taking  into  account  that  f  r(yQ)  =  ^(Xq)  , 

(-y^)  r*(-f)  +  f  (Xq)  =  -f  r  (y^)  +  f  (Xq)  =  0  . 

On  the  other  hand  since  Xq  «  Fy^  ,  we  have  for  each  g  that 

(-yo)r*(-g)  +  g(Xo)  =  -(gr)*(yQ)  +  g(xQ) 

^  -gr(yQ)  +  g(XQ)  ^  o  . 

This  signifies  that  (-y^j)  F^  ( • )  -  Xq  ( • )  attains  its  minimum  equal  to  zero  at 
-f  .  The  proof  is  complete. 

5.10  Proposition 

Assume  that  weak  #  —duality  holds.  If  Xq  is  a  solution  of  (5.13) 
and  <Pq  is  a  solution  of  (5.14),  then  (Xq  ,  ^q)  is  a  saddle  point  of  the 
Lagrangian  of  Kurcyusz  (3.21)  ; 

(5.20)  L(xQ,9»,yQ)  s  L(XQ,9)Q,yQ)  ^  L(x,?>Q,yQ) 

for  each  x  €  X  and  each  <p  i  i  . 

Proof 

By  Proposition  5.8,  <pQ  is  a  subgradient  of  fF  at  yp  ,  thus  by 
Proposition  3.13  the  second  inequality  holds. 
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Exercises 

1.  Parametric  problems  consist  In  minimizing  over  X 

Wq) 

provided  that  e  A  ^  (x,  Wq)  ,  where  f  :  X  x  w  —  R  and 

Z  — 2^  Find  a  problem  representation  (1.5)  for  the  general 

parametric  problem. 

2 .  (Rockafellar) 

In  particular,  let  f:  XxW-»Ru{  +  oo}.  Consider  the  problem 

(f(-  .Wq),X,  (X.Tq)  )  . 

Determine  a  constraint  representation  (T,  Wq)  ,  r  :  W  —  2^^^ 
that  yields  a  problem  representation  of  the  type 

(f,  r,  Wq,  (XXW,  TqX  )  . 

Show  that  the  Lagranglan  of  the  associated  multifunction  and  of  the  class 
#  X  1  (see  p.3J  )  Is  of  the  form 

L(x,w,<p)=  Inf  (f(x,z)-<p(z)) 
z  «  Y 

3.  Let  R  be  a  normed  space,  K  a  closed  convex  cone  In  R  ,  fa  mapping 
from  a  topological  space  (X,  t)  Into  R  ,  A  a  subset  of  X  .  A  Pareto 
minimization  problem  (vector  minimization)  Is 


(f,  (R.K),A,  (X,  T)  )  . 
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A  solution  of  the  problem  is  an  element  Xq  of  A  such  that  there 
is  a  neighborhood  Q  of  Xq  such  that  for  each  x  in  A  fl  Q  , 
f(XQ)  -  f  (x)  /  K  .  Our  problem  (1.1)  is  a  special  case  of  Pareto 
minimization. 

If  (r»yo)  is  a  constraint  representation,  then  the  associated 
multifunction  n  is  defined  by 

o(y.z)={x:  z«f(x)  +  K}nry  . 

Find  a  geometrical  interpretation  of  singular  points.  What  is  the  form  of 
the  Lagrangian  of  (2  and  of  a  class 


f  +  4^2  :  :  Z  -  R  ,  4^2  *  R }  . 

Consider  a  set  * "  *  »  real-valued  functions  on  a  topological  space 

(X ,  t)  .  Let  a  be  the  natural  topology  of  r”’  .  Then  Xq  is  an 
extremal  for  either  all  of  or  none  of  the  following  representations. 

(fj » Ij »  (fj  »  *  *  *  »  1  ^^0^ '  ^J+1  ^^0^  *****  fjjj  (^0^  ^ 

where 

TjCri,  •••  ,rj_i,rj^l,  •••  ,rm)  =  {x  :  f^(x)  s  r^  ,  1/j}  . 
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5.  a)  (  [1]  )  Let  A  be  a  subset  of  a  set  X.  A  family  P  of  functions 
p  ;  X  —  R  U  {+»)  is  called  a  penalty  system  for  A  ,  if 
(i)  Xp  €  P  for  each  X  >  0  and  p  e  P 


(ii) 

p(x)  £  0 

for  each  x  e  A 

and 

p  «  P 

(iii) 

for  each 

X  /  A  there  is 

p  €  P 

such  that 

p(x)  >  0 

(Iv) 

for  each 

X  «  A  there  is 

P  €  P 

such  that 

P(x)  >  - 

Let  f  ;  X— R  U  {+«>}  .  Show  that  if  P  is  a  penalty  system  of  A  , 
then 

inf  sup  (f(x)  +  p(x))=  inf  f(x)  . 

X€XP«P  X€A 

b)  (Dolecki-Kurcyusz  [  £,  ] )  Let  i  be  a  class  of  real-valued  functions 
on  Y  satisfying  (3.10)  ,  let  r  :  Y— 2^  . 

Define 

P(yo)=^"  sup  ?>(y)  +  fl»(yo)  *  }  • 

y  €  r”^x 

show  that  if  for  each  x  the  set  r  ^x  is  i  -convex  and  Fy  =  ^  , 

y  €  Y 

then  for  each  y^  P(yQ)  ^  is  a  penalty  system  for  FyQ  . 

6.  [  1  ]  Let  i  be  composed  of  regular  functions  and  let  be  of  type  (3.6). 
Show  that  if  fFg  is  upper  semicontinuous  at  yQ  and 

may  be  separated  from  epi  fFg  by  an  element  i|>  of  f  ,  then  strong 
§  -duality  holds. 

7.  Using  the  definition,  find  F^  from  Example  5.2. 


8.  Prove  Proposition  3.16. 
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9  .  Show  that  for  a  problem  representation  (4.1) 

where  A  is  a  basis  for  t  . 

O.U.  say  that  a  aultltwctlon  r:Y  2*  la  «-obaatvable  at(y„,x„)  ..benavat 

for  aath  nalghborhood  Q  of  thara  axlats  a  nalghborhood  U  of  y„  tuch  that 

-1  ® 
co^  r  Q3W  . 

Show  that  if  T,  $  are  those  of  Example  5.2  .then  the  4-observability  of  F 
(at  (0,0))amounts  to  the  existence  of  k>0  such  that 

>kH^I  ^  ^eY*. 
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